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SUMMARY 


Distribution  theory  for  the  likelihood  ratio  statistics 
for  the  comparison  of  several  treatments  with  a  control  is 
discussed.  These  tost  statistics  account  for  prior  information 
that  the  treatments  are  at  least  as  effective  as  the  control. 
Their  null  distributions  are  mixtures  of  chi-squared  or  beta 

distributions  and  the  mixing  coefficients,  which  are  ''level 

>- 

probabilities",  are  intractable  for  even  a  moderate  number 
of  treatments  and  unequal  weights,  which  are  typically  the 
sample  sizes.  The  distribution  corresponding  to  equal  weights 
is  considered  as  an  approximation  and  an  approximation  based 
on  the  pattern  of  large  and  small  weights  is  developed.  Both 
are  adequate  for  moderate  variations  in  the  weights,  but  the 
approximation  based  on  patterns  in  the  weight  set  is  considerably 
more  accurate  for  larger  vacations. _ 


2 


1.  INTRODUCTION 

We  consider  the  situation  in  which  one  wishes  to  compare 
several  treatments  with  a  control  or  standard  when  it  is 
believed  that  the  treatments  are  at  least  as  effective  as 
the  control.  For  example,  in  a  drug  study,  several  drugs 
may  be  compared  to  a  zero  dose  control. 

Assuming  that  the  observations  are  normally  distributed, 
let  H1  denote  the  hypothesis  that  y1  _<  y.^  for  i  =  2,...,k, 
where  y^^  is  the  control  mean  and  the  y^  for  2  <_  i  <_  k,  are  the 
treatment  means.  Barlow,  Bartholomew,  Bremner  and  Brunk  (1972) 
discuss  testing  homogeneity,  ie.  HQ :  Uj  =  y2  *  ...  ■  y^ 
versus  an  arbitrary  partial  ordering  on  the  y ^  and  call  the 
ordering  specified  by  a  simple  tree  ordering.  Robertson 
and  Wegman  (1978)  consider  tests  with  the  partial  order 
restriction  the  null  hypothesis.  In  both  of  these  situations, 
the  distribution  of  the  likelihood  ratio  test  (LRT)  under  Hq 
is  a  mixture  of  chi-squared  or  beta  distributions  depending 
on  whether  the  variances  are  known  or  not.  The  mixing 
coefficients  are  the  probabilities,  under  Hq ,  that  the  maximum 
likelihood  estimates  (MLEs)  of  the  y^,  subject  to  the  partial 
order  restriction,  have  a  specified  number  of  distinct  values. 
These  coefficients,  which  are  also  called  level  probabilities, 
depend  upon  the  precisions  of  the  sample  means.  The  precisions 
will  be  referred  to  as  weights.  We  will  see  that,  even  in  the 
case  of  a  simple  tree  ordering,  the  level  probabilities  can  be 
very  tedious  to  compute  for  unequal  weights  and  moderate  k. 


Dunnett  (1955,  1964)  proposed  a  test  of  Hg  versus  Hj-Hg, 
that  is  but  not  Hg .  For  the  case  of  unknown  variances, 
the  test  statistic  is  the  maximum  of  appropriate  pairwise 
t-test  statistics.  Robertson  and  Wright  (1983b)  studied  the 
power  functions  for  this  test,  the  LRT  and  the  one-sided 
t  test  which  compares  the  control  mean  with  the  pooled  treat¬ 
ment  means.  While  Dunnett' s  test  and  the  t  test  are  more 
powerful  in  some  subregions  of  the  alternative  space,  the 
LRT  maintains  a  more  reasonable  power  throughout  H^. 

We  consider  approximations  for  the  level  probabilities 
needed  to  implement  the  LRT  for  a  simple  tree  ordering  and 
unequal  weights.  For  a  total  order  such  as  <_  y2  1  •••  1. 
Siskind  (1976)  and  Grove  (1980)  observed  that  the  level 
probabilities  are  robust  to  moderate  variations  in  the  weights 
and  conjectured  that,  except  in  extreme  cases,  the  level 
probabilities  associated  with  equal  weights  should  provide 
reasonable  approximations.  Robertson  and  Wright  (1983a)  studied 
their  conjecture  in  the  totally  ordered  case  and  found  that 
for  many  practical  applications  this  approximation  is 
satisfactory.  They  also  found  that  the  quality  of  the 
approximation  depends  on  the  pattern  of  the  larger  and  smaller 
weights,  and  they  developed  an  approximation  based  upon  such 
patterns.  Following  their  work  we  study  the  equal-weights 
level  probabilities  as  an  approximation  and  develop  an 
approximation  based  on  the  pattern  of  large  and  small  weights 
for  the  simple  tree  ordering. 
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In  Section  2,  the  level  probabilities  are  studied  as 
functions  of  the  weights.  Upper  and  lower  bounds  for  the 
tail  probabilities  of  the  LRT  statistics  are  determined 
and  these  bounds  are  shown  to  be  sharp.  In  Section  3,  the 
accuracy  of  the  equal-weights  approximation  is  considered 
for  particular  types  of  weight  sets,  as  well  as  randomly 
generated  weight  sets.  As  in  the  totally  ordered  case,  it 
is  found  that  for  many  practical  situations  the  equal-weights 
approximation  is  adequate.  However,  for  large  variation  in 
the  weights  and  certain  patterns  of  large  and  small  weights, 
there  may  be  considerable  error  in  this  approximation.  In 
Section  4,  the  limiting  values  of  these  mixing  coefficients 
are  obtained  for  each  possible  weight  set  in  which  only  two 
values  are  assumed  with  one  value  constant  and  the  other 
approaching  infinity.  Using  these  results,  an  approximation 
is  proposed  which  outperforms  the  equal-weights  approximation 
for  weight  sets  with  a  large  amount  of  variation. 
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2.  THE  LEVEL  PROBABILITIES 

Suppose  X.^,  j  *  l,...,n^  and  i  =  l,...,k  are  independent 

random  samples  from  k  normal  populations  with  means  vu  and 
2  2  2 

variances  *  a7b  with  a^  known  and  b  ■  1  if  known.  Let 

denote  the  sample  means,  let  w  *  ^ . w^)  with 

2 

w^  =  n^/a^  denote  the  vector  of  weights  and  let  P(£,k;w) 
denote  the  probability,  under  Hg,  that  IT  =  (p^ , . . . , p^) ,  the 
MLE  of  p  =  (y^,...,Pjc)  subject  to  the  restriction  H^,  has 
exactly  £  distinct  values. 

For  the  case  of  known  variances,  the  LRT  statistic  for 
Hq  versus  Hx  -  Hfl  is  TQ1  -  £i  =  1  w^pj-p)  where 

V  =  ^i-l  "i^i^i-l  wi  and  under  V 

X*(t)  =  pr(T01  >  t)  =  l\x2  PCfc.kjwjprfx^.j  >  t)  for  t >  0.  (1) 


The  LRT  statistic  for  H1  versus  pi  <  p^  for  some  i  is  T12  = 

7.  .  w-Cp.-jf.)  .  Within  H,  ,  Hn  is  least  favorable  and  under  Hn , 

^l^l  l  i  i  10  0’ 

pr(T12-t^  *  Efcli  Pf^.hjwjprCx^^t)  for  t>0.  (2) 

_2 

The  x  distributions  in  (1)  and  (2)  arise  as  approximations 
when  considering  multinomial  parameters  (cf.  Robertson  (1978)), 
one-parameter  exponential  families  (Robertson  and  Wegman  (1978)), 
Poisson  intensities  (Magel  and  Wright  (1984))  and  nonparametric 
tests  (Shirley  (1977)  and  Robertson  and  Wright  (1983b)).  In 
the  normal  case  with  b  unknown,  the  LRT  statistics  are 

soi  ■  Ii-1  aI2<v:,z  a"d 

S12  ’  lf-1  ai2'xij-“)2  and  the  tail 
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probabilities  under  Hq  are 

pr(S01-t)  "  ^£-2  P^,k;w)pr(B(il-l)/2,  (N-Jl)/2  - 

and 

pr(Si2>t)  -  z£;J  P(t,k;w)pr(B(k.l)/2((M.k)/j  >  t),  (4) 


where  N  *  T .  ,  n.  and  B  ,  is  a  random  variable  with  beta 
Li=l  i  a,b 

distribution  with  parameters  a  and  b. 

The  level  probabilities  can  be  obtained  by  the  explicit 
formulas  discussed  in  Barlow  et  al.  (1972,  p.  146)  if  k  £  4 
and  for  k  >  4  they  can  be  obtained  by  their  recursive  relation 
(3.23)  and  repeated  numerical  integration  of  their  (3.38) 

For  the  simple  tree  ordering  and  k  £  2,  their  (3.38)  and  (3.23) 
become 


P(k,k;w) 

and  for  1  <  £  <  k, 

P(£,k;w) 


00  k-1  V!i  +  il/2 

{  n  $((_i_L)i/^x)}<(>(x)dx 

-00  i  =  i  wi 


£P(£,£;W(B))P(l,k-£+l;w(B))  , 
B 


(5) 

(6) 


where  <t>  and  $  are  the  c.d.f.  and  p.d.f.  for  a  standard  normal 
distribution,  the  sum  in  (6)  is  over  subsets  of  (1,2, ...,k) 
which  include  1  and  have  cardinality  k-£+l,  W(B)  is  a  vector 
of  length  £  whose  first  coordinate  is  w^  and  its  remaining 

coordinates  are  the  w^  with  i  {  B,  and  w(B)  is  a  vector  of 
length  k-£  +  l  made  up  of  the  w^  with  i  e  B  and  w^  is  its  first 
coordinate.  For  the  simple  tree  ordering,  P(£,k;w)  =  P(£,k;w') 
if  wj  *  w^  and  w£,...,w£  is  some  permutation  of  W2»...,Wj(. 

So  the  order  of  the  last  £-1  coordinates  of  W(B)  and  the 
order  of  the  last  k-£  coordinates  of  w(B)  is  not  important. 
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Even  for  moderate  k,  computation  via  (5)  and  (6)  can  be  quite 
tedious.  If  =  ...  *  wk,  we  suppress  the  w  in  the  notation, 
and  note  that  their  equations  (3.38)  and  (3.39)  give 

f  00 

P(k,k)  *  (4>(x))k_1$(x)dx  =  1/k ;  for  2  <  i  <  k-1 

'  -00 

_  M  oo 

P(£,k)  =  (k“J)P(l,k-*+l)  [$(x(k-Jl  +  l)'1/2)]k'1<j.(x)dx;  (7) 

J  -00 

and  P(l,k)  *  1  -  l\s2  P(i,k). 

The  P(fc,k)  for  2  <_  k  <_  12  are  given  in  Table  A. 6  of  Barlow  et  al . 
(1972) . 

2 

Since  the  x  and  beta  distributions  in  (1)  and  (3)  increase 
stochastically  with  i,  upper  and  lower  bounds  for  these  tail 
probabilities  are  found  by  obtaining  upper  and  lower  stochastic 
bounds  for  the  discrete  distributions,  Pk(w),  which  assign 

probability  PU,k;w)  to  l  for  l  =  1,2 . k;  cf.  Theorem  1  of 

Robertson  and  Wright  (1982).  In  (2)  and  (4)  the  x2  and  beta 
distributions  decrease  with  Z  and  so  upper  bounds  for  these  tail 
probabilities  are  obtained  by  finding  lower  stochastic  bounds  for 
Pk(w)  and  vice  a  versa. 

Let  I.(*)  denote  the  indicator  function  of  the  set  A, 

t\ 

for  k  _>  2  and  1  <  l  <  k,  define 

AU,k)  =  1  {k_i  ,k>  ^)/2  and  B(*,k)  =  (klJ)21_k 

and  let  Ak  and  Bk  be  the  corresponding  discrete  distribution 
on  ( 1 , . . . ,k) .  The  mixing  coefficients,  B(t,k)  were  encountered 
in  Dykstra  and  Robertson  (1982,  1983)  and  Robertson  and  Wright 
(1982).  The  proof  of  the  following  theorem  uses  an  algorithm 
for  computing  the  MLEs  restricted  by  the  simple  tree  ordering 
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which  is  an  immediate  consequence  of  either  Thompson's 
minimum  violator  algorithm  or  the  minimum  lower  sets  algorithm 
(MLSA) ,  cf.  Barlow  et  al.  (1972,  Section  2.3).  Arrange  the 
treatment  sample  means  in  increasing  order,  X^)  £  ...  £  ^(k)  ’ 
let  Xj  =  Xx,  let  X!  =  X^-j  for  i  =  2,...,k,  let  wj  *  Wj  and 
let  w |  be  the  weight  associated  with  X^  for  i  =  2,...,k. 
Choose  j  to  be  the  smallest  positive  integer  with 


M.  =  (V  i  w!  X-!)/^  .  w!  <  JC» 
j  £i=l  x  l"  61  =  1  1  j+1 


and  if  no  such  j  exists,  let  j  =  k.  The  restricted  MLEs  are 

y.  =  M.  if  X.  is  included  in  M.  and  IT.  *  X.  if  not.  The  first 
l  j  1  J  ii 

level  set,  S^,  consists  of  those  is  for  which  ji\  =  and, 
assuming  there  are  no  ties  among  X^ j +i) * • • • »^(k) *  there  are 
k  -  j  +  1  level  sets. 

THEOREM  1.  For  k  _>  2  and  any  vector,  w,  of  positive  weights, 
A^  and  Bj,  are  upper  and  lower  stochastic  bounds  for  Pk(w). 
Furthermore,  if  w(n)  =  ( 1/n ,1 , . . . , 1)  and  w(n)  =  (n,l,...,l), 
then  P(£,k;w(n))  -*■  A(«.,k)  and  P(£,k;  w'(n))  -*■  B(£,k)  as  n  +  “. 


Proof.  To  establish  that  A^  is  an  upper  bound  we  only  need  to 
show  that  P(k,k;w)  <  1/2.  This  follows  immediately  from 


P(k,k;w)  =  pr(X^  <  X^  for  i  =  2,...,k).  The  proof  that  B^  is 
a  lower  bound  is  by  induction.  Clearly,  P(l,2;w)  =  P(2,2;w) 


=  1/2.  So  we  consider  k  ^  2  and  define  Nj,,  Sj.  and  y^  ^  to  be 
the  number  of  level  sets,  the  first  level  set  and  the  value 
of  y  on  the  first  level  set  in  the  restricted  MLEs  based  on 


X^ » •  •  •  *  Xj^  with  weights  w^,...,w^«  Let  +  ^ ,  S^  +  ^  snd  y  ^  k+ 1 
be  the  corresponding  values  determined  by  the  MLEs  based  on 
Xj,...,Xjc+^  with  weights  w^  , . . .  ,w^+ ^  .  As  in  the  earlier 
discussion,  let  ■  card.  (S^) . 
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Define  Av(C)  ■  ^{i;i6C}wi^i^{i’i€C}wi  ^  ?  C  c  {l,...,k}. 

We  first,  show  that  Nk+1  _>  +  I  »)  ^k+1^  *  Because  t^ie 

estimates  are  restricted  MLEs,  we  know  that  if  Xjc+^  >  y^  k, 
then  *  ^k+1  and  Nk+1  =  Nk+1.  If  5Ck+1  <  y1>k,  then  we 

will  show  that  Sk+1  c  Sk  u  {k+1}.  For  it  not,  there  is  an 
i  «  Sk+1  -  (S,  u  {k+1})  and  so  i  M,  ^k+1  1  Av(Sk)  <  3T 
which  implies  Av(Sku{k+l>)  <  )T.  But  by  the  MLSA, 

Av(Sk+i)  <_  Av(Sku{k+l})  and  hence,  Av(sk+i  "  ti})  <  Av(Sk+1) 
which  contradicts  the  choice  of  Sk+1  according  to  the  MLSA. 

So  pr(Nk+1  1  l  *  1)  1  Pr(Nk=l'^k+l  >  pi,k^  +  pr(Nk  1  £  +  » 

but  the  proof  given  for  (3.23)  in  Barlow  et  al.  (1972)  shows 
that  pr(Nk  =  £,Xk+1  >  P1>k)  = 

I  pr(Av(Sk)  <  Xa  for  all  a  e  (1 . k}-Sk,Xk+1>Av(Sk) )P(Sk) 

where  the  summation  is  overall  Sk  c  {l,...,k}  which  contain  {1} 
and  have  cardinality  k  -  l  +  1  and  P(Sk)  is  the  probability 
that  Av(S)  _>  Av(Sk)  for  all  S  which  are  proper  subsets  of  Sk 
and  contain  {1}.  But  because  Av(Sk)  <_  X^  this  sum  is  bounded 
below  by 

|^pr(Av(Sk)  <  XQ  for  all  a  e  {l,...,k}  -  Sk)P(Sk), 

which  according  to  their  (3.23)  is  P(t,k;w)/2.  Applying  the 
induction  hypothesis,  Pr(Nk+i  Z.  £  +  1)  _>  (pr(Nk^st)+pr(Nk>^+l))/2 

~  ^  ^a*it+l  ot-1  ^a*!l+l^ (a»k+l )• 

It  remains  to  be  shown  that  these  bounds  are  sharp, 
however  these  results  are  special  cases  of  Theorem  2  and  4. 

The  proof  is  completed. 


10 


_? 

To  give  some  idea  of  the  influence  of  w  on  the  x  tail 
probabilities  given  in  (1),  the  values  of 

xi(t)  *  ij^AU.kJprCxf.jit)  and  xB(t)  =  ^=2B(£,k)pr(:xLl-t) 

with  t  =  e0  05(k),  the  equal  weights  0.05  critical  value,  are 
given  in  Table  1  for  various  k. 
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3.  THE  EQUAL  WEIGHTS  APPROXIMATION 


Primarily,  we  study  the  accuracy  of  approximations  as 
they  apply  to  (1),  the  tail  probabilities  of  Bartholomew's 

__7 

X  test  statistic.  If  one  uses  the  0.05  equal  weights  critical 
value  when  in  fact  the  weights  are  not  equal  the  true  significance 
level,  a,  may  be  quite  different  from  0.05.  For  instance, 
we  see  from  Table  1,  if  k=5  then  a  may  be  as  small  as  0.0141 
or  as  large  as  0.0794.  However,  in  practical  situations  the 
discrepancy  may  be  much  less.  Since  the  upper  and  lower 
bounds  occur  as  the  limiting  cases  for  w  =  (1,R,...,R)  and 
w  =  ( R , 1 , . . . , 1 )  respectively,  it  is  of  interest  to  consider 
the  corresponding  discrepancies  for  moderate  values  of  R.  The 
second  and  fourth  columns  of  Table  2  contain  the  values  of  (1) 


for  these  weights  with  k  =  5  and  t  =  eQ  q5(5)  =  7.655.  We 


—  7 


and 


denote  the  value  corresponding  to  (1,R,...,R)  by  (t) 

_7 

that  corresponding  to  (R,l,...,l)  by  Xg^g)!*)  •  The  results 
presented  in  Table  2  seem  to  indicate  that  if  k=5  and  R, 
the  ratio  of  the  largest  weight  to  the  smallest,  is  two  or 
smaller  and  one  uses  eQ  05(5),  then  0.044  a  _<  0.057  and 
if  R  <  3,  then  0.040  <_  a  <_  0.060.  To  further  substantiate 
these  claims  5000  sets  of  random  weights  were  generated. 

In  particular,  five  independent  weights  uniform  on  ( 1 , )  were 
generated  and  the  value  of  (1)  was  computed  at  t  =  7.655.  In 
5000  replications,  all  the  values  of  (1)  were  between  0.044 
and  0.056  for  Ru  =  2 ,  and  for  Ry  =  3  they  were  between  0.040 


and  0.060. 
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To  give  an  indication  of  the  behavior  of  the  equal-weights 

approximation  for  arbitrary  weights,  random  weights  were 

generated.  Five  independent  uniform  (0,1)  random  numbers, 

_2 

U^,...,L’5,  were  generated  and  with  w^  =  IK,  xw  C  7 .653)  and  R 
were  computed.  The  second  and  third  columns  of  Table  3  contain 
a  frequency  distribution  for  the  5000  replications  of  this 
experiment  along  with  the  minimum  value  of  R  for  each  cell. 

For  those  5000  eight  sets,  we  note  that  if  R  <  2.06  then 
0.044  £  a  £  0.056  and  if  R  <  3.34  then  0.04  <_  a  <_  0.06. 

Next  we  consider  the  accuracy  of  the  approximation  as 
k  increases.  While  it  is  difficult  to  compute  the  level 
probabilities  for  arbitrary  w  and  larger  k,  the  P(£,k;w),  with 

weights  of  the  form  B (R)  =  (R,l . 1)  and  A (R)  =  (1,R . R) , 

are  much  more  tractable.  For  k  =  8  and  w  =  B(R),  A (R)  the 
level  probabilities  were  computed  and  (1)  was  evaluated  at 
t  =  eQ  Qc;  (8)  =  11.807.  These  results  are  found  in  the  sixth 
and  eighth  columns  of  Table  2.  While  the  limiting  values  are 
considerably  more  extreme  at  k  =  8,  the  increase  in  the  errors 
for  the  equal-weights  approximation  for  k  =  8  over  k  =  5  are 
not  so  large  when  R  =  2  or  3. 

For  many  practical  situations  the  equal -weights  approximation 
to  the  critical  values  of  Bartholomews  x  test  is  adequate. 
However,  in  some  situations,  in  particular  for  moderate  k  and 
considerable  variation  in  the  w^s,  other  approximations  need 
to  be  considered.  In  the  next  section  an  approximation  based 
on  the  pattern  of  large  and  small  weights  is  considered. 
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4.  AN  APPROXIMATION  BASED  ON  PATTERNS  IN  THE  WEIGHTS 

In  the  totally  ordered  case,  Chase  (1974)  developed 

an  approximation  for  the  situation  in  which  w 2  ~  • . .  =  w^ 

and  w1/w2  >  1.  His  approximate  critical  values  are  obtained 

by  interpolating  between  the  critical  values  for  the  equal- 
—2  —2 

weights  x  distribution  and  the  x  distribution  corresponding 
to  the  limiting  P(£,k;w)  as  w^  -*■  ®  with  w^  =  ...  *  w^  fixed. 
Robertson  and  Wright  (1983a)  extended  Chase's  ideas  to  provide 
an  approximation  for  the  totally  ordered  case.  We  use  a 
similar  approach  for  the  simple  tree  ordering. 

First,  we  obtain  the  limiting  values  for  P(£,k;w)  for  each 
situation  in  which  the  w.^  assume  only  two  values,  one  of  which 
remains  constant  and  the  other  approaches  infinity.  Since 
P(£,k;w)  *  P(£,k;w')  for  w'  *  (cWj , . . . .cw^)  with  c  >  0,  the 
exact  value  of  the  constant  weights  is  immmaterial.  The  cases 
in  which  the  first  weight  is  either  small  or  large  are  different. 

For  the  case  in  which  the  first  weight  is  large  we  define 
Q(£,k;s)  to  be  lini  P (£ ,k ; w(n,  s) )  with  the  first  k-s  coordinates 

of  w(n,s)  equal  to  n  and  the  last  s  coordinates  equal  to  1  with 
1  ^  s  <  k.  For  notational  convenience  we  set  P ( 1 , 1 )  =  1. 

THEOREM  2.  For  k  _>  2  and  1  <_  s  <  k,  (Q(£,k;s)}  is  the  convolution 
of  (P(£,k-s) }  with  the  binomial  probabilities  with  parameters 
s  and  1/2. 

Proof.  The  proof  is  by  induction.  For  £  =  1  or  2,Q(£,2;1)  = 
lirn^mP(£ , 2 ; (n, 1) )  =  .5  and  so  the  desired  result  holds  for  k  =  2. 


Fix  k>  2,  2  £  £  £  k  and  1  £  s  £  k-2.  For  the  vector  of 
weights  w(n,s)  and  the  simple  tree  ordering,  (6)  gives 
Q(£,k;s)  = 

liin^  l  (^(J'l'JjPCt.tJw'Cn.^JPd.k-fliWfn.v))  (8) 
n  v  =  0 

where  w' (n,v)  has  its  first  coordinate  equal  to  n (k- £- v* 1 )  , 

the  next  £+v-l-s  coordinates  are  n  and  the  last  s-v  are  1 
and  w"(n,v)  has  its  first  k-£-v+l  coordinates  equal  to  n  and 
its  last  v  are  1,  The  summand  is  zero  if  £+v-l-s  or  k-£-v  is 
negative.  Applying  (S), 

r°° 

limn^o=p(£.^w,(n»v))  =  4)S’VJ  CHAx)^-1-s0Cx)dx 
1 

“  2 

where  A  =  (k-£-v+l)  ,  but  applying  (5)  again  the  right  hand 

S-\; 

side  can  be  written  as  P (£  +  v- s , £  + v-s ; (k- £- v+1 , 1 , . . . , 1 ) ) /2 

By  the  inductive  hypothesis,  if  v>0,  P ( 1 , k- £+1 ; w" (n , v) )  approaches 

P(l,k-£-v+l)/2v  and  if  v=0,  the  two  expressions  are  equal. 

So  (8)  becomes 

s  1  k  1 

l  (*)  (4)SCr|l:)P(il+v-s,£+v-s;  (k- £- v+ 1 , 1 ,  .  .  .  ,1)  )P(1  ,  k  -  ?  -  ,  1 ) 
v=0 

and  applying  (3.39)  of  Barlow  et  al.  (1972),  this  becomes 

I  O (y)SP(£+v-s,k-s) , 
v  =  0  L 

which  is  the  desired  result.  Since  Q(l,k;s)  *  1  -  [£3?Q(£ ,k;s)  the 
result  also  holds  for  £=1.  The  proof  for  s  *  k-1  is  like  the 
above  except  (8)  becomes 

(£;J)P(£,£;(n-k-£,l,. ..,l))P(l,k-£  +  l;(n,l,...,l))  . 

The  proof  is  completed. 

For  the  case  in  which  the  first  weight  is  small,  we  define 
R(£,k;s)  to  be  the  lini  P(£,k;w*(n,s))  with  1  <  s  <  k,  the 
first  s. coordinates  of  w*(n,s)  equal  to  1  and  the  other  k-s 


coordinates  equal  to  n.  We  need  not  consider  s  *  k,  for  if 

all  the  coordinates  of  w*(n,s)  are  1,  then  P(Jt,k;w* (n,s) )  = 

P(A,k).  For  the  purpose  of  computing  P(£,k;w)  we  may  assume 

»  0  for  i  -  l,...,k.  Consider  w*(n,s),  a  fixed  point  in 

the  underlying  probability  space  where  the  5T  are  all 

distinct  and  sufficiently  large  n.  Choose  a  so  that 

X  *  min  .  .  As  n  X  becomes  degenerate  at  2ero 

a  s+l^i£k  1  a  b 

and  so  u\  <  0.  Since  X  <  X.  for  s  <  i  <  k  with  i  f  a, 

<  y\  for  such  i.  So  the  number  of  level  sets  is  k-s-1 
plus  the  number  of  distinct  values  in  (y ^ , . . . , y  , 0) . 

For  k  >  2  and  1  <  l  <  k,  define  S(£,k)  *  lim  P ( l , k  ;  ( 1 , . .  . , 

—  —  —  It-*'00 

THEOREM  3 .  For  k  >  2  and  1  <  i  <  k,  S(£,k)  is  determined  by 

S(k,k)  =  (l-(y)k"1)/(k-l),  S(l,kW-[k  =  2S(*,k)  and  for  2<H<k-l 

-1 

0 

Proof.  The  proof  is  by  induction.  Applying  (5)  and  letting 
n  ®,  we  see  that 

oo 

S(k,k)  =  jo(<f(x))k‘20(x)dx  =  (l-(4)k'1)/(k-l)  , 

and  of  course  £k  S(fc,k)  =1.  So  the  desired  result  holds 

i  =  l 

for  k*2.  Consider  k^3  and  2£t£k-l,  applying  lb), 

S(il,k)  =  1inin^oe{(k:2_1)P(£,t;(n+k-l,l . 1 ) ) P ( 1 , k-  1*1 ;  ( 1 . 

rfc,£;(k-£  +  l,l,...,l,n))P(l,k-£«-l)}. 

By  (5)  lin  .  '  .  ;(n-k-t,l . l))-(y)t_1  and 

1  im  P  (  ^ ^  » (k“^,  +  1»1f  •  •  •  * 1 » Ji) )  -  f  (4((k-lM)1/2x))l‘2^(x)dx. 

n  J  0 

The  conclusion  follows  from  the  inductive  hypothesis. 
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The  values  of  S(£,k)  for  k-2,...,10  and  l£^k  are  given 
in  Table  4. 

THEOREM  4.  Let  k^2  and  l<s<k.  For  k-s<£<k,  R(JL,k;s)  * 
S(£+s+l-k,s+l)  and  for  l<£<k-s,  R(£,k;s)  =  0. 

Proof.  The  proof  is  by  induction.  For  k-2,  s*l  and  R(£,2;s) 

*  S(£,2)  by  definition.  Consider  k>3  and  l<s<k  and  note  that 

because  R(£,k;s)  and  S(£,s+1)  are  probability  vectors,  we 

only  need  to  establish  the  first  claim.  Computing  P(k,k;w* (n,s) ) 

1  c 

using  (5)  and  letting  n->-“>,  we  see  that  R(k,k;s)  =  (l-(j)  )/s  = 

S (s-*-l , s  +  1)  .  For  max(2  ,k-s)££<k,  we  use  (6)  to  compute 
P(£,k;w*(n,s) )  and  write  R(£,k;s)  as 

limn^  'iV^H./C^^An.vJJPd.k-wy^n.v))  (10) 

where  the  first  coordinate  of  w**(n,v)  is  v+l  + (k- i- v)n,  the 
next  s-v-1  coordinates  are  1,  the  last  t-s  +  v  coordinates  are 
n,  the  first  v+1  coordinates  of  w***(n,v)  are  1,  and  the  last 
k-Jl-v  coordinates  are  n.  First  consider  k-s<£<k  or  0<k-£<s. 

If  v>k-£.  then  k-£-v<0  and  the  corresponding  term  in  (10)  is 
zero.  If  v-k-£,  then  P(1 ,k-£+l ;w***(n,v) )  =  P(l,k-£+l)  and 
computing  P(£,2.;w**(n,v)  using  (6)  we  see  that  the  term  with 
v*k-2.  in  (10)  approaches 

(j^J)P(l,k-t*l)J  (♦((k-m)'1/2x))s  +  £‘k'1*(x)dx, 

which  is  the  second  term  in  the  representation  of  S(£+s+l-k,s+l) 
given  in  (9).  If  v*k-£.-l,  then  P(l,k-£  +  l,v^**(n,v))-*-S(l,k-£*l) 
and 

»o o 

P()l,Jl;w*^n,v))  +  (i)*  +  s'k  (4(x))k's'1<Kx)dx  -  (2*+s'k(k-s) )  * 

J  -00 
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Hence,  the  terra  with  v=  k-£-l  in  (10)  approaches 

j 

which  is  the  first  term  in  the  representation  of  S(£.+s+l-k,s+l)  ! 

given  in  (9).  For  v<k-£-l,  P  (1  ,k- Jt+1  ;w***(n,  v)  )-*-R(l  ,k- £+1 ;  v+1) 
and  k-X.  +  l<s  +  l£k  and  so  the  inductive  hypothesis  holds. 

R(1  ,k-£+l ; v  +  1)  =  0  since  l<k-2.  +  l- (v+1)  =  k-JL-v. 

Finally  we  consider  2.=k-s.  If  s=k-l,  then  w*(n,s)  *  (1 . l,i 

and  R(£,k;k-1)  =  S(i.,k)  =  S(l,s+1)  which  is  the  desired 
conclusion.  If  s<k-l,  then  (10)  is  applicable  for  Jl=k-s>_2. 

However,  the  term  with  v  =  s-l  in  (10)  is  (k-s) P(k-s ,k-s ; (s+n,n, . . . , 
n))R(l,s+l)  which  approaches  (k- s) P (k-s , k-s) R(1 , s+1 ) =R(1 , s+1) .  For 
v<s-l,  k-d-v=s-v>l  and  so  P (1  ,k-£+l ; w***(n, v)  )-+R(l  ,k- £  +  1 ; s- v) , 
which  by  the  inductive  hypothesis  is  zero.  The  proof  is  completed. 

We  now  describe  a  method  of  obtaining  approximate  p-values 
or  approximate  critical  values.  Given  a  weight  set  wi»****w](> 
classify  each  weight,  w..,  as  small  if  w^<w  or  large  if  v/^>w. 

We  considered  choices  for  w  of  the  form  w  =  a  min  w^+(l-a)max  w^ 
and  w  =  S  min  w^  and  based  on  numerical  studies  recommend 
w  =  1.5  min  w^.  Next  find  the  p-value  or  critical  value 
determined  by  the  limiting  level  probabilities  if  the  small 
weights  were  fixed  at  one  and  the  large  weights  approached 
infinity.  Finally,  interpolate  between  the  limiting  value 
and  the  equal-weights  value.  For  instance,  the  approximate 
p-value  is  given  by 

p  -  /F  pg  +  ( 1-  /r)  P^ 


(ID 
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where  r  is  average  of  the  small  weights  divided  by  the  average 
of  the  large  weights,  Pg  is  the  equal-weights  p-value  and 
is  the  appropriate  limiting  p-value.  The  choice  of  y 
for  the  exponent  on  r  is  based  on  numerical  studies  also. 
Replacing  the  p-values  in  (11)  by  the  appropriate  critical 
values,  one  obtains  approximate  critical  values,  which  we 
denote  by  a^fk). 

Robertson  and  Wright  (1983  a,b)  studied  the  errors  for 
analogous  approximate  p-values  as  well  as  the  errors  in  the 
level  of  significance  corresponding  to  approximate  critical 
values.  In  both  cases,  it  was  found  that  for  p-values  and 
levels  of  significance  of  similar  magnitudes,  the  errors 
were  similar  in  size.  For  that  reason,  we  only  study  the 
errors  in  significance  levels  arising  from  approximate  critical 
values.  Columns  3,5,7  and  9  of  Table  2  contains  the  true 
significance  levels  corresponding  to  aQ  Q5(k)  for  w  =  (R,l,...,l) 
and  (1,R,...,R)  with  k  *  5,8  and  several  values  of  R.  For  such 
weights,  the  approximation  given  in  this  section  clearly 
outperforms  the  equal-weights  approximation.  It  is  also  clear 
from  Table  2,  that  the  interpolation  scheme  given  here  puts 
too  much  weight  on  the  limiting  critical  values  for  small 
values  of  R.  However,  this  scheme  was  chosen  because  of  its 
performance  on  randomly  generated  weight  sets. 

Because  of  the  way  it  was  developed,  we  would  expect  that 
this  approximation  would  perform  well  for  weight  sets  with 
only  two  distinct  values  and  so  we  wish  to  compare  it  with 
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the  equal-weights  approximation  for  arbitrary  weight  sets. 

Recall,  that  Table  3  contains  a  frequency  distribution  of 
_2 

xw^e0  05^  *0T  SOM  sets  of  weights  which  are  pseudo  independent, 

uniform  random  variables  on  (0,1).  For  these  same  weight  sets 

_2 

the  frequency  distribution  of  Xw(ag  05)  is  also  given  in 
Table  3.  It  is  clear  that  the  approximation  proposed  in 
this  section  is  also  more  accurate  than  the  equal-weights 
approximation  for  these  randomly  generated  weight  sets. 
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Table  1 

•  xlctj 

and  Xg 

(t)  with 

11  *  eo . 

05 

k 

3 

4 

5 

6 

7 

8 

9 

(t) 

0.0331 

0.0217 

0.0141 

0.0094 

0.0058 

0.0037 

0.0023 

(t) 

0.0669 

0.0746 

0.0794 

0.0827 

0.0850 

0.0863 

0.0881 

10 

0.0015 

0.0891 


h  m  to  m 
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Table  2.  and  x|(R)(t)  with  t*e0.05(k)»  a0J)5(k)  for  k*5,| 


k-S  k-8 


w»(l,R, 

. . . »R) 

w»(R,l 

» • • • *  1) 

. . .  ( R) 

w=(R,l, 

...,u 

R 

ta,e0.05(5) 

*"*0.05^ 

tme0.05(S) 

t,ao.osts) 

taeo.o5(8) 

taao.os(8) 

t"e0.0S(8) 

taa0.05(8) 

1.5 

0.0539 

0.0494 

0.0462 

0.0506 

0.0553 

0.0498 

0.0446 

0.0528 

2.0 

0.0566 

0.0492 

0.0436 

0.0S06 

0.0590 

0.0499 

0.0408 

0.0536 

3.0 

0.0601 

0.0492 

0.0403 

0.0501 

0.0636 

0.0501 

0.0360 

0.0534 

5.0 

0.0641 

0.0494 

0.0370 

0.0491 

0.0687 

0.0503 

0.0307 

0.0520 

10.0 

0.0684 

0.0497 

0.0337 

0.0481 

0.0740 

0.0505 

0.0255 

0.0495 

100.0 

0.0759 

0.0500 

0.0301 

0.0482 

0.0829 

0.0504 

0.0193 

0.0472 

00 

0.0794 

0.0500 

0.0141 

0.0500 

0.0863 

0.0500 

0.0037 

0.0500 
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_ 2  _ 7 

Table  3.  Frequency  distribution  for  (7.653)  and  Xw(ag  os(5) 
for  5000  randomly  generated  weight  sets 

X'(7.653)  x£Ca0_05C5)) 


Interval 

Frequency 

Minimum  R 

Frequency 

Minimum  R 

(0.032, 

0.036) 

47 

8.87 

0 

(0.036, 

0.040) 

397 

4.85 

3 

15.41 

(0.040, 

0.044) 

957 

2.29 

120 

5.96 

(0.044, 

0.048) 

1196 

1.39 

829 

1.39 

(0.048, 

0.052) 

868 

1.14 

2555 

1.14 

(0.052, 

0.056) 

543 

1.39 

345 

2.77 

(0.056, 

0.060) 

397 

2.06 

140 

4.32 

(0.060, 

0.064) 

242 

3.34 

54 

6.88 

(0.064, 

0.068) 

180 

5.87 

16 

10.38 

(0.068, 

0.072) 

110 

12.11 

2 

112.14 

(0.072, 

0.076) 

55 

26.77 

0 

(0.076, 

0.080) 

8 

123.94 

0 
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Table  4.  Limiting 

level 

probabilities 

S(i,k)« 

lim 

P(A,k; (l, 

...,1 

2  3 

4 

5 

k 

6 

7 

8 

9 

10 

1  .5000  .1250 

.0270 

.0052 

.0009 

.0002 

.0000 

.0000 

.0000 

2  .5000  .5000 

.  2083 

.0625 

.0153 

.0032 

.0006 

.0001 

.0000 

3  .3750 

.4730 

.2604 

.0974 

.0285 

.0070 

.0015 

.0003 

4 

.2917 

.4375 

.  2910 

.1280 

.0431 

.0120 

.  0029 

5 

.2344 

.4017 

.3073 

.1535 

.  0579 

.0178 

6 

.1937 

.3687 

.3145 

.1740 

.  0721 

7 

.  1641 

.3395 

.3161 

.1902 

8 

.1418 

.3139 

.  3141 

9 

.1245 

.2917 

10 

.1109 
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Distribution  theory  for  the  likelihood  ratio  statistics  for 
the  comparison  of  several  treatments  with  a  control  is  discussed. 
These  test  statistics  account  for  prior  information  that  the 
treatments  are  at  least  as  effective  as  the  control.  Their  null 
distributions  are  mixtures  of  chi-squared  or  beta  distributions 
and  the  mixing  coefficients,  which  are  "level  probabilities", 
are  intractable  for  even  a  moderate  number  of  treatments  and 
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unequal  weights,  which  are  typically  the  sample  sizes.  The 
distribution  corresponding  to  equal  weights  is  considered  as  an 
approximation  and  an  approximation  based  on  the  pattern  of 
large  and  small  weights  is  developed.  Both  are  adequate  for 
moderate  variations  in  the  weights,  but  the  approximation  based 
on  patterns  in  the  weight  set  is  considerably  more  accurate  for 
larger  variations. 


